Variance Minimization Least Squares Support Vector Machines for Time Series Analysis
ثبت نشده
چکیده
Here we propose a novel machine learning method for time series forecasting which is based on the widelyused Least Squares Support Vector Machine (LS-SVM) approach. The objective function of our method contains a weighted variance minimization part as well. This modification makes the method more efficient in time series forecasting as this paper will show. The proposed method is a generalization of the well-known LS-SVM algorithm. It has similar advantages like the applicability of the kernel-trick, it has a linear and unique solution, and a short computational time, but can perform better in certain scenarios. The main purpose of this paper is to introduce the novel Variance Minimization Least Squares Support Vector Machine (VMLS-SVM) method and to show its superiority through experimental results using standard benchmark time series prediction datasets.
منابع مشابه
Comments on "Pruning Error Minimization in Least Squares Support Vector Machines"
In this letter, we comment on "Pruning Error Minimization in Least Squares Support Vector Machines" by B. J. de Kruif and T. J. A. de Vries. The original paper proposes a way of pruning training examples for least squares support vector machines (LS SVM) using no regularization (-gamma = infinity). This causes a problem as the derivation involves inverting a matrix that is often singular. We di...
متن کاملPrimal-Dual Framework for Feature Selection using Least Squares Support Vector Machines
Least Squares Support Vector Machines (LSSVM) perform classification using L2-norm on the weight vector and a squared loss function with linear constraints. The major advantage over classical L2-norm support vector machine (SVM) is that it solves a system of linear equations rather than solving a quadratic programming problem. The L2norm penalty on the weight vectors is known to robustly select...
متن کاملIteratively-Reweighted Least-Squares Fitting of Support Vector Machines: A Majorization-Minimization Algorithm Approach
Support vector machines (SVMs) are an important tool in modern data analysis. Traditionally, support vector machines have been fitted via quadratic programming, either using purpose-built or off-the-shelf algorithms. We present an alternative approach to SVM fitting via the majorization–minimization (MM) paradigm. Algorithms that are derived via MM algorithm constructions can be shown to monoto...
متن کاملLeast-squares support vector machine and its application in the simultaneous quantitative spectrophotometric determination of pharmaceutical ternary mixture
This paper proposes the least-squares support vector machine (LS-SVM) as an intelligent method applied on absorption spectra for the simultaneous determination of paracetamol (PCT), caffeine (CAF) and ibuprofen (IB) in Novafen. The signal to noise ratio (S/N) increased. Also, In the LS - SVM model, Kernel parameter (σ2) and capacity factor (C) were optimized. Excellent prediction was shown usin...
متن کاملThe differogram: Non-parametric noise varia estimation and its use for model selection
achines; Model-free estimates of the noise variance are important in model selection and tuning parameters. In this paper a data representation is discussed which leads to estimator suitable for multivariate data. Its visual representation—called the differogra here—is based on the 2-norm of the differences of input and output data. The crucial of locality in this representation is translated a...
متن کامل